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Multilayered coding supports migration to new standard 



FIELD OF THE INVENTION 

The invention relates to a method of supplying encoded content data such as 
audio, video, multimedia, etc. The invention also relates to software for implementing a 
decoder for decoding encoded data representative of content information, and to an electronic 
device comprising a decoder for decoding encoded data representative of content 
5 information. The invention relates in particular, but not exclusively, to the field of consumer 
electronics (CE). 

BACKGROUND ART 

Multi- layer coding or compression techniques are being used to process 

10 content source data in order to create multiple layers of data. The layers are to be overlaid or 
otherwise combined to regenerate the source data. The layers comprise, for example, a base 
layer and one or more enhancement layers. Typically, the enhancement layers are used as an 
option for enhancing the rendering of the content represented in the base layer. Techniques 
exist that allow a video coding standard, intended or designed for a normal video signal, to be 

15 used for coding the enhancement layers. Accordingly, multi-layer compression allows the use 
of new and more efficient compression techniques while still having a compatible base layer. 

SUMMARY OF THE INVENTION 

The inventors have realized that multi-layer coding or compression techniques 

20 are suitable tools for a service provider, e.g., a video-on-demand service or a cable operator, 
to facilitate the transition from a first coding or compression standard to a second coding or 
compression standard, when the first is in the process of getting obsolete. More specifically, 
the multi-layer coding enables the service to gradually migrate over time from an installed 
base of receivers to a contingent of next generation receivers. 

25 Therefore, an embodiment of the invention relates to a method of supplying 

encoded content data. The method comprises enabling to control a circuit to operate in a 
specific one of multiple operational modes. A first one of the operational modes relates to 
decoding a base layer of the content data using a first decoding technique and to decoding an 
enhancement layer of the content data using a second decoding technique different from the 
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first. Typically, the enhancement layer represents the difference between the base layer signal 
and the full-content signal. A second operational mode relates to decoding the content data 
using the second technique. Preferably, the enabling to control comprises providing control 
data specifying the specific operational mode. In a further embodiment of the invention, the 
5 first technique uses a conventional decoding scheme, and the second technique uses a new or 
emerging standard that is getting to replace the conventional scheme. 

Another embodiment of the invention relates to an electronic device 
comprising a decoder for decoding encoded data representative of content information. The 
decoder has a first operational mode and a second operational mode. In the first mode the 

1 0 decoder is operative to decode a base layer of the data using a first decoding technique, and 
to decode an enhancement layer of the data using a second decoding technique different from 
the first. In the second mode the decoder is operative to decode the data using the second 
technique. The decoder is controllable to operate in either the first or the second mode. 

Yet another embodiment relates to a physical record carrier with data 

15 representative of content information. The data comprises the content information encoded in 
a base layer using a first encoding technique, e.g., based on a conventional standard and an 
enhancement layer using a second encoding technique, e.g., based on an emerging standard, 
different from the first. The data also comprises the content information entirely encoded 
with the second technique. 

20 A rationale for the invention as discussed above is the following. The service 

provider is faced with a dilemma during the time when the market is transferring from an 
established standard to an emerging standard: should the service provider supply the same 
content in different standards, i.e., at least twice, or should the service provider halt any 
content supply in the conventional standard? By definition, an emerging standard is not yet 

25 supported by the majority of receivers out in the field. The first option implies that the 

provider can only supply part of the content that his/her channel capacity allows. The second 
option has as a consequence that conventional receivers out in the field are all rendered 
obsolete at the moment the conventional standard transmissions stop. As a result, some 
subscribers are not going to be too pleased. In addition, the second option also causes the 

30 problem of determining when exactly the transmissions in the conventional standard are to 
stop. The invention facilitates the transition to a new standard by means of using a layered 
coding scheme with a base layer and one or more enhancement layers. The base layer is 
encoded in the conventional standard, the enhancement layers use the emerging standard. As 
a result, receivers with a conventional decoder are enabled to receive the content in a base 
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layer quality. Receivers that have both a conventional decoder plus a decoder compliant with 
the nevs^ standard, referred to as hybrids, are capable of processing the complete content, i.e., 
base plus enhancement layers. When, say after the expected lifetime of the conventional 
receiver has expired, the service provider transmits content only in the new, now established 
5 standard, the hybrids still are capable to process the complete content by switching decoding 
of all data to the new standard decoder. To the service provider, channel capacity during the 
transition is efficiently used under the constraints that conventional receivers as well as 
hybrids are to be capable of receiving content. Furthermore, the hybrids need not be replaced 
by the time the transmissions in the conventional standard have stopped, which is again a 

10 good thing to the subscribers. 

The invention is specifically, but not exclusively, relevant to a class of 
(currently) emerging video coding standards referred to as H.26L (also called NfPEG4 part 
10, AVC or H.264) that is expected to supersede MPEG-2, MPEG-4 SP or MPEG4 ASP. The 
H.26L standard comprises elements common to the MPEG standards, and the H.261 and 

15 H.263 standards. For background information see, e.g., "Recent Advances in Video 
Compression Standards", Guy Cote and Lowell Winger, IEEE Canadian Review- 
Spring/Printemps 2002, pp. 2 1 -24. 

For clarity, when the text of this document refers to H.26L or MPEG4 part 10 
or H.264, the text is meant to refer to the same class of currently emerging video coding 

20 standards. 

BRIEF DESCRIPTION OF THE DRAWING 

The invention is explained in further detail, by way of example and with 
reference to the accompanying drawing wherein: 
25 Figs. 1 and 2 are block diagrams of systems in the invention. 

Throughout the figures, same reference numerals indicate similar or 
corresponding features. 

DETAILED EMBODIMENTS 
30 Fig. 1 is a block diagram of a system 100 in the invention. Data representative 

of content information is supplied at an input 102. The data is subjected to a low pass and 
decimation filter 104 that reduces the resolution of the data received. An output of low-pass 
filter 104 is connected to an input of a base encoder 106. Such encoder and filter are well 
known in the art and do not need further discussion here. Encoder 106 supplies a base stream 
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108 representing the content information at a low resolution. The term "low resolution" here 
is meant to refer to the content in an acceptable format for being perceived when rendered, 
but of a relatively low quality. Base stream 108 as is can be, e.g., stored or supplied to an 
end-user, e.g., via a data network 1 10. As to the latter, base stream 108, as received via 
5 network 1 1 0 by an end-user 1 1 6, is subjected to a decoding operation in a decoder 1 1 8 and an 
up-sampling operation in a circuit 1 19 and is then rendered at a TV set 1 14. 

The data at input 1 02 Is also supplied to an adder 1 20 via a decoder stage 1 22 
and a circuit 124 that subjects the decoded data from stage 122 to interpolation and sub- 
sampling operations. Circuit 124 outputs data that is compatible to the input data at input 102 

1 0 with respect to subjecting it to data processing operations. For example, the data supplied by 
circuit 124 has the same resolution as the input data at input 102. Adder 120 then forms a 
linear combination of the data from circuit 124 and the data from input 102 by means of 
subtracting the former from the latter. The residual data is then supplied to an enhancement 
encoder 126 to produce a stream 128 of residual data or enhancement data. Enhancement 

15 stream 128 can be combined with base stream 108 to recreate the high resolution of the data 
as originally received at input 102 and is discussed next. 

An end-user 130 receives both base stream 108 and enhancement stream 128. 
Enhancement stream 128 is decoded by an enhancement decoder 132, whose output is 
coupled to an adder 134. Base stream 108 gets decoded in a decoder 136 and is made 

20 compatible with the decoded enhancement data by a circuit 138 that carries out interpolation 
and up-sampling operations. The output of circuit 138 is coupled to adder 134 as well Adder 
134 combines the decoded base stream data and decoded enhancement stream data for being 
rendered at, e.g., a TV 140 that is suitable for rendering the high-resolution or enhanced 
content. 

25 The enhancement data typically represents pixels whose values are 

concentrated around zero. Accordingly, if the range of pixel values of the enhancement data 
is transformed into a range of values compatible with those of the base data, standard 
electronic encoding and decoding components can be used in enhancement encoder 126 and 
decoder 132. Therefore, a modification unit 142 is used to add a DC offset to the pixel values 

30 supplied to encoder 126, and a modification unit 144 is used to subtract the DC offset from 
data received from decoder 132. 

In the invention, encoder 106, and decoders 1 18 and 136 use a coding 
technique based on a conventional standard, e.g., MPEG-2, whereas encoder 126 and decoder 
132 use a coding technique based on an emerging standard, e.g., H.26L. User 1 16 is capable 
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of rendering content supplied in the conventional standard. User 130 is capable of rendering 
content encoded in the conventional standard, plus content encoded in a multi-layer scheme 
using a combination of the conventional standard and the emerging standard as explained 
above, A service provider migrating from the conventional standard to the emerging standard 
5 may decide to use the hybrid encoding scheme for base and enhancement streams as 

discussed above. An advantage of this scheme is that the channel capacity allocated to this 
provider gets content to both users 1 16 and 130, both being enabled to render the content 
received, without the provider having to transmit the complete content once in the 
conventional standard and once in the emerging standard. A further advantage is that user 

10 130 can keep on using his/her equipment after the provider has made the full transition to the 
new standard. In this manner, the time scale of providers switching to a new standard is more 
or less made compatible with the time scale of customers or subscribers renewing their 
equipment. The hybrid equipment of user 130 therefore enables him/her to keep on receiving 
content while bridging the transition period and to receive content after the new standard has 

15 been established. After the provider has stopped supplying content in the conventional, now 
obsolete, standard and has begun to supply content 146 in the new standard, the data follows 
the path as marked in the drawing in bold lines. Encoder 126 and decoder 132 are then re- 
used to encode and decode, respectively, the complete content. Also note that the input of the 
rendering apparatus, here TV set 140, is to be switched to the proper path using a switch 148. 

20 Control of switch 148 is, e.g., explicit by means of the equipment of user 130 receiving 
control data, e.g., via path 1 46 or by means of the user him/herself flipping a switch upon 
receipt of a notification. Control of switch 148 can also be done implicitly, namely upon the 
equipment of user 130 detecting an absence of base stream 108. 

Fig. 1 illustrates the base stream and enhancement stream as separate items at 

25 both the transmission side and the receiver side. Note that such streams can be physically 

represented in the same transport stream or program stream. Decoders 1 1 8, 122, and 136 can, 
but need not be identical circuits. Similarly, up-sampling circuits 124 and 138 are preferably 
identical or have preferably identical behavior. The coding schemes of base codecs 106, 1 18, 
122 and 136 include, e.g., MPEG-2, MPEG-4, H.261, H.263, or another conventional 

30 standard supported by a large enough installed base of receivers, i.e., the addressable market, 
in order to be commercially relevant to the service provider. On the other hand, codecs 126 
and 132 use an emerging standard, e.g., H.26L, that is to supersede the conventional standard 
as it provides a lower bit rate for a given picture quality or that has other advantages over the 
latter. 
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TV sets 1 14 and 140 each comprise, e.g., a digital TV set based on, e.g., the 
SDTV (Standard Definition Television) format, SDTV is a digital television (DTV) format 
that ensures an image quality similar to that from a DVD. 

A similar scenario along the lines sketched out above is advantageous in a 
5 transition phase from the SDTV display format to, e.g., the HDTV (high-definition TV) 
display format, the tatter providing a higher resolution. A DTV channel first supplies SDTV 
in a base layer in MPEG2 and an HDTV enhancement layer in H264. A user of an SDTV set 
and a user of a combination of an HDTV set plus a hybrid decoder as shown in component 
130 are then both enabled to receive and render the broadcast. After the market has 

1 0 transferred to equipment (TV sets and STB or other receivers) compliant with the HDTV- 
formaty the broadcast can be made single*layer H264. 

Above examples relate to content supplied via a data network. Fig. 2 is a block 
diagram of a system 200 in the invention illustrating that the same concept also applies to 
content supplied recorded on a physical record csirrier, e.g., a solid state memory, an optical 

1 5 disk, a magnetic disk, etc. 

System 200 comprises components of end user 130 as discussed under Fig. 1. 
System 200 further comprises in this example a reader and control circuit 202 that enables 
user 130 to render content supplied on an optical disk 204 and encoded in a hybrid scheme. 
The content comprises a base layer 206 encoded using a first technique and an enhancement 

20 layer 208 encoded in a second technique different from the first. Again, the first technique 
may relate to a conventional standard and the second technique to an emerging standard as 
discussed under Fig. I . Circuit 202 reads out the data as a base stream 210 and enhancement 
stream 212 and supplies the data to the proper ones of decoders 132 and 1 36 as discussed 
above. Circuit 202 is further capable of processing content data supplied on a disk 214 that is 

25 entirely encoded in the second technique. Control data may be stored on disk 214 to control 
switch 148, or to generate a notification message to be rendered on TV set 140 so as to notify 
the user of switching the operational mode of his/her equipment. 

It should be clear that another proper rendering device can be used instead of a 
TV set as illustrated in the drawing, without deviating from the scope of the invention. It 

30 should also be clear that the field of the invention is not limited to video data, but applies in 
general to all kinds of content including audio, graphics, video, multimedia, etc. It is also 
clear that what has been described above with regard to the transition from a conventional 
standard to an emerging standard may also apply to a transition from any standard to another 
standard. 
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Incorporated by reference herein are the following patent documents: 
Unpublished International Application no. PCT/IB02/04395 (attorney docket 
NL 021039) filed Oct.21, 2002, for Pons Bruls for SPATIAL SCALABLE COMPEIESSIOR 
This document relates to an apparatus and a method for performing spatial scalable 
5 compression of video information captured in a plurality of frames. A base layer encoder 
uses a first coding standard to encode a bitstream. An enhancement layer encoder uses a 
second coding standard, different from the first, to encode a residual signal. The residual 
signal is the difference between the original frames and the upscaled frames from the base 
layer. 

10 - Unpublished Internationa! Application no. PCT/1B02/04373 (attorney docket 

NL 021040) filed Oct. 21, 2002, for Pons Bruls and Rene Klein Gunnewiek for DC OPFSET 
IN FRONT OF ENHANCEMENT CODER. This document relates to spatial scalable 
compression of video. Base layer encoding provides a bitstream with a relatively low 
resolution. Enhancement layer encoding encodes a residual signal for providing a second 

15 bitstream. A modification is provided prior to the enhancement layer encoding for 

transforming the residual signal into a signal with a level range of a normal input video 
signal. 

Unpublished International Application no. PCT/IB02/04389 (attorney docket 
NL 021041) filed Oct. 21, 2002, for Rene Klein Gunnewiek and Pons Bruls for 

20 INCREASING EPPICIENCY OP SPATIAL SCALABLE CODING. This document relates 
to a method and an apparatus for providing spatial scalable compression using adaptive 
content filtering of a video stream. The video stream is downsampled to reduce the resolution 
of the video stream. The downsampled video stream is encoded to produce a base stream. 
The base stream is decoded and upconverted to produce a reconstructed video stream. The 

25 reconstructed video stream is subtracted from the video stream to produce a residual stream. 
The resulting residual stream is encoded in an enhancement encoder and outputs an 
enhancement stream. The residual signal in selected frames is muted in the enhancement 
encoder while the motion information in the frame is maintained. 

Unpublished International Application no. PCT/IB02/04370 (attorney docket 

30 NL 021042) filed Oct. 21 , 2002, for Pons Bruls and Rene Klein Gunnewiek for 

INCREASING EFFICIENCY FOR SPATIAL SCALABLE CODING. This document relates 
to an apparatus for efficiently performing spatial scalable compression of an input video 
stream. A base encoder encodes a base encoder stream. Modifying means modifies content of 
the base encoder stream to create a plurality of base streams. An enhancement encoder 
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encodes an enhancement encoder stream. Modifying means modifies content of the 
enhancement encoder stream to create a plurality of enhancement streams. 

U.S. ser.no. 09/521,051 (attorney docket US 000052) filed March 8, 2000, for 
Geert Bruynsteen for BUSINESS MODEL FOR LEASING STORAGE SPACE ON A 
5 DIGITAL RECORDER, published under PCT as International Application WOOl 67743. 
This patent document relates to adjusting, via a data network, the available amount of storage 
space of a fixed HDD on a CE device. The consumer can upgrade the device via a third party 
service that remotely control's the HDD's settings. 

Similarly, various compression algorithms associated with respective upgrades 
10 can be remotely enabled by the manufacturer, the dealer or the content provider. 



